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(57) Abstract 

Apparatus for compressing data is disclosed in which input data is compressed by a vector quantization process (22) and 
decoded by the vector quantization process (30). The input data and the decoded input data are compared and a different signal 
(dr) is produced. A portion of the difference signal (drs) is preferably losslessly compressed and transmitted with the vector quan- 
tized input signal to a decoder over a communication channel. The decoder (14) decodes the vector quantized portion of the sig- 
nal (Ivq) and the compressed difference signal (dLR) for reconstructing the input signal with an error which is less than that 
which would result from uncompensated vector quantization. 
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WO 92/09142 j ' PCT/US90/06670 

MffTOQn & A PPARATUS FOR DATA 
COMPRESS IO W WTTH REDUCED DISTORTION 

BACKGROUN D OF THE INVENTION.; 

The invention relates generally to data 
compression. More specifically, the invention relates 
to a method and apparatus for compressing image data 
utilizing and encloding technique which results in 
reduced distortion or error in the data. 

Numerous fields of endeavor make use of vector 
quantization processing. One newly emerging application 
is data compression. The preferred embodiment of the 
invention will be described with particular reference to 
compression of image signals , though such an 
illustration is not a limitation on its scope. 

A quantizer is a device which represents one signal 
which can take on a large number of values by another 
signal which can take on only a limited number of 
values '. A four bit analog-to-digital converter, for 
example, represents the value of a continuously varying 
(i.e., analog) signal by a digital signal which can have 
only one of sixteen values. Scaler quantizers operate 
on signals having a single degree of freedom, such as an 
analog-to-digital converter operating on a voltage 
signal. Vector quantizers operate on signals having 
multiple degrees of freedom as will be discussed more 
fully below. 

A vector quantizer for compressing video images 
conceptually divides the image into numerous small areas 
called pixels (a term formed from the words "picture" 
and "element") . Pixels are sufficiently small that the 
intensity of the image is approximately constant across 
the pixel area. For example, a black and white image of 
a house might be divided into a grid of 600 rows and 600 
pixels per row. Each pixel would be like a small dot in 
the image. A group of pixels together would form a 
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vector which can be thought: of as a small sub image. For 
example a 6 x 6 square patch of pixels forms a vector 
which may be a portion of a shadow, or part of the roof 
line against a light background. Vectors formed from an 
image shall be called image vectors • The present 
invention operates on vectors which, for the illustrated 
example, are image vectors. In general, any source of 
vector signals may be used, and vectors which are 
subject to quantization are more generally referred to 
as input vectors. 

While a black and white image serves as an example 
here, vectors might also be formed from red, green, or 
blue levels from a color image. They might also be 
formed from Y,l and Q components of a color image, or 
from transform coefficients of an image signal on which 
a Hadamard, Fourier, or other transform has operated. 

Numerous methods exist for manipulating an image to 
form image vectors. For example, a television camera 
might generate an analog video signal in a raster scan 
format having 600 scan lines per frame. An analog-to- 
digital converter could then digitize the video signal 
at a sampling rate of 600 samples per scan line. 
Digital signal processing equipment can then store the 
digital samples, and group them into vectors. The 
process of digitizing an analog video signal is a form 
of scaler quantization which is similar to but distinct 
from methods of vector quantization. The discussion 
which follows assumes that one of many methods well 
known in the art of signal processing can be used to 
produce input digital image signals. 

Before quantizing an image, a vector quantizer 
stores a set of "codebook" vectors in memory. Codebook 
vectors are vectors which are chosen to be 
representative of commonly found image vectors. The 
quantizer stores a sufficient variety of codebook 
vectors so that at least one closely matches each of the 
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-.many vectors that might be found in the full image. 
Each codebook vector is assigned a unique identification 
code. The set of all codebook vectors is called a 
codebook. 

In practice, the identification code for a codebook 
vector may be an address in a memory which stores the 
vector values. The precise order of the entries may be 
arbitrary, or it may be selected according to some 
property of the vectors. 

When quantizing a full image, a vector quantizer 
divides the full image into a series of image vectors. 
For each image vector, the vector quantizer identifies 
one closely matching codebook vector. The vector 
quantizer then generates a new signal made up of the 
series of the identification codes of the selected 
codebook entries. 

Regeneration of the full image can be accomplished 
by a device which has the complete codebook stored in 
memory. The device regenerates the image signal by 
replacing each ID code in the quantized signal with its 
corresponding codebook vector. The regenerated image 
differs from the original image, because codebook 
entries do not precisely match the original image 
vectors. The difference is called distortion or loss. 
Some forms of compression result in little or no loss. 
In effect, the input signal is changed in form but not 
in quality. While such compression techniques may not 
significantly effect or reduce bandwidth or processing 
time, other advantages such as improved signal quality 
or equipment compatibility may result. However, when 
system constraints exist, it may be necessary to suffer 
a certain level of distortion. The amount of such 
distortion which is tolerable depends , in part , on 
whether it is noticeable. In video transmission systems 
for example, the viewer may be the best judge of whether 
the distortion is in fact acceptable. Some vector 
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quantizer systems have produced acceptable distortion 
with conventional video formats (i.e. 512 x 512 pixels) . 
High definition television (HDTV) however has 
approximately 5 times the data of conventional TV 
5 formats. Accordingly compression techniques which 

produce tolerable distortion levels for conventional 
television may not work with HDTV. Also, if bandwidth 
requirements can be reduced without loss of picture 
quality, channel capacity may be increased. 

10 SUMMARY O F THE INVENTION t 

The present invention comprises a method and 
apparatus for compressing an input signal with reduced 
distortion. A vector quantizer responsive to the input 
signal produces a vector quantized signal representative 

15 of an approximation of the input signal. A decoder 
responsive to the vector quantizer signal, produces a 
replica of the input signal which has a distortion 
resulting from such vector quantization equal to the 
difference between the input and replica. In a 

20 preferred embodiment a lossless compressor responsive 
to the difference, losslessly encodes a selected 
significant portion of said difference. A decoder 
responsive to the vector quantized signal and the 
encoded portion of the difference produces an output 

25 signal different from the input by an amount less than 
the distortion resulting from vector quantization. 

BRIEF DESCRIPTION O F THE DRAWINGS: 

Fig 1 is a schematic block diagram of the 
apparatus for compressing data with reduced distortion 
30 according to the present invention; and 

Fig. 2. is a graphic representation of a data input 
limit as a function of buffer fullness employed in the 
present invention. 
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PCTATUID DESCRIPT ION OF THE PREFERRED EMBODIMENT: 

The discussion which follows makes use of 
mathematical concepts and notations from the field of 
vector algebra. Such notations provide precise and 
widely understood terms which are. best suited to 
disclosing the operation of the invention. 

TERMS & NOTATIONS; 

Scalar: A single value. Scalars are denoted by 
lower case letters (sometimes with subscripts) . For 
example, a scalar may be designated as "a" or as H a 1 w . 

Vector: An ordered set of scalars. Vectors are 
denoted by upper case letters (sometimes with 
subscripts) . For example, a vector may be designated as 
n A M or "Ai". The dimension of a vector is the number of 
scalar elements in the ordered set. Vectors may also be 
denoted by listing its scalars in brackets. For 
example, a two dimensional vector may be designated as 
a 2 } w . A set of vectors shall be designated by am 
underlined capital letter. For example, a set of 
codebook vectors may be designated as 

Mean: A scaler which is the average of the scaler 
value of a vector divided by the number n of vector 
elements. 

_ n 

A - Z a w / n 
1 

Address: Identification code for a codebook entry. 

Norm: A scalar which is a measure of the magnitude 
of the vector. The norm of a vector shall be denoted by 
an upper case letter (which designates the vector) 
between vertical bars. For example, for a vector A = 

a 2>f the norm of A is a scaler h & i.e., 



|A| = h, 



Unless otherwise noted , the norm of a vector may be 
calculated as sum of the absolute values of the scalar 
values of a vector, e.g.: 

|A| = h a = |aj + |a 2 |. 

Vector Sum: A vector sum is itself a vector whose 
scalar elements are the sum of the corresponding 
elements of two vectors. For example, for two vectors 
A « {a> x , a 2 } and B = {b x , b 2 } the sum of A and B is a 
vector C, i.e. : 

A + B = C — {c lf c 2 } = { (a x + b x ) , (a 2 + b 2 ) } . 

Vector Difference: A vector whose scalar elements 
are the differences of the corresponding elements of the 
two vectors. For example, for two vectors A » (a lf a 2 } 
and B = {b lf b^} the difference between A and B is a 
vector's, i.e.? 

A - B = E * (e x , e*} = { (a x - b x ) , (a 2 - b 2 ) } . 

Distance: A scalar which is the norm of the vector 
difference between the two vectors. Distance shall be 
denoted by the small case letter d followed by two 
vectors in parenthesis^ For example, for two vectors A 
« {a lf a 2 } and B = {b t , b 2 ) , the distance between A and B 
shall be a scalar h written as: 

d(A,B) = h A , B = | A - B| 

For the purpose of this discussion, the norm is 
taken as the sum of the absolute values of the scalar 
elements of the distance vectors. Written another way: 



d(A,B) ~ h x , B = [A - B[ - | (ax - bt) | + | (a 2 - b 2 ) | . 
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The distance might alternatively be one of the well 
known Euclidenn Norms, such as square root of the sum of 
the squares of the differences of the scalar elements of 
the vectors* Written another way: 

d(A,B) = h A#B = V (a x - bj 2 + (a 2 - b 2 ) 2 

5 The following definitions are also included here 

for convenience. 

Codebook Vector: A vector which is representative 
of a region of a vector space. 

Input Vector: A vector which serves as input data 
10 to a vector quantizer. 

Image Vector: A vector formed from image data. 
Measure: An operator which provides a unit of 
comparison, e.g. distance or magnitude. 

Representative Element: An element of a set which 
15 is representative of a subset of elements from the set 

(e.g. a codebook vector is representative of a subset of 
all possible vectors) . 

Input Element: An element which serves as an input 
to a processor which matches the input element to a 
20 representative element (e.g. an input vector is an input 

to a vector quantizer) . 

THE SEARCH METHOD: 

Xn accordance with a preferred embodiment of the 
present invention , input data in digital form is 

25 subjected to a vector quantization process developed by 

Richard Baker and published in June, 1984 in his PhD. 
Dissertation entitled "Vector Quantization of Digital 
Images" at -Stanford University. Baker's algorithm known 
as Mean Residual Vector Quantization quantizes or 

30 compresses an input data stream. 
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The codebook set may be designed in accordance with 
an article by Buzo and Gray entitled "An Algorithm for 
Vector Quantizer Design", TREE Transactions On 
Communications, Vol. Com. -28, No. 1 (Jan. 1980). 
Thereafter, the vectors from the codebook are searched 
in order to map the input vector with the closest 
codebook vector. In order to reduce distortion or error 
various search techniques have been developed to find 
the best match. One very accurate and fast technique is 
disclosed in copending patent application of Bi et al 
entitled "A Full Search - Equivalent Method For Matching 
Data And A Vector Quantizer Utilizing Such Method" , 

Serial No. ,. Filed June 9, 1989, and assigned to 

Utah State University Foundation, the assignee herein, 
the search technique disclosed in Bi et al employs the 
following steps: 

1) compute a norm or other characteristic measure 
of the input vector I, 

2) identify a reference codebook vector Aj having 
a norm which is closest to the norm of the 
input vector I, 

3) compute the distance h z>J between the input 
vector I and the reference codebook vector A Jf 

4) identify a subset s of the codebook vectors 
made up of codebook vectors having a norm in 
the range |l| - h Zti to |l| + h I(J . 

5) search the subset £ for the codebook vector 
having the smallest distance to the input 
vector. 

6) select the codebook vector having the smallest 
distance to the input vector. 

In all such search methods there is a difference 
between the input vector and the codebook vector because 
codebooks have less information and all possible input 
vectors. For example in the Bi et al search method 
described above, the distance between the vectors is a 
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measure of distortion. For purposes of images, other 
norms (i.e., other measures of distortion) can be 
defined. Typically distortion can be reduced by 
increasing the accuracy of the search method so that the 
best codebook vector is selected. Accuracy can also be 
increased by adding more codebook vectors to the table. 
These techniques increase processing time and bandwidth 
requirements which is often undesirable and 
counterproductive. Also once the vector quantized 
signal is transmitted it is not possible to accurately 
correct for distortion. In accordance with the present 
invention, distortion is accurately characterized prior 
to transmission, and the most significant distortion 
information is transmitted with the vector quantized 
signal so that the image can be reassembled with reduced 
distortion. 

SYSTEM DESCRIPTION; 

Fig. 1 is a block diagram of a statistically 
lossless compression system 10 according to the present 
invention. Statistically lossless may be defined as a 
non zero loss which is not perceptible at the desired 
resolution . The system 10 includes an encoder/ 
transmitter 12 for encoding and transmitting a data 
stream and a decoder/receiver 14 responsive to the 
encoder 12 over a channel 16 for receiving and decoding 
and reassembling the data stream with reduced 
distortion. The encoder 12 includes an image input 18 
which receives an analog input via input channel 20. In 
the preferred embodiment the analog input is a video 
signal. Image input 18 converts the analog signal to an 
input vector I t . A mean residual vector quantizer (MRVQ) 
22 vector quantizes the input vector I t . The MRVQ may 
be operable in accordance with the algorithm described 
in Baker* s paper and the Bi et al patent application 
referred to above . Also , a preferred circuit for 



searching the codebook in the MRVQ is described in the 
patent application of Paxil D. Xsraelsen entitled "Vector 
Quantizer Codebook Processing Circuit", Serial No. 
333,976 Filed April 6, 1989 and assigned to the Utah 
State University Foundation, the assignee herein. The 
MRVQ 22 has a table of codebook vectors stored therein. 
The vector input I t is encoded as am address 
representative of the location in memory of the stored 
codebook vector selected in accordance with the Bi et al 
search method. The MRVQ also produces a mean which is 
the average of the scalar of values of the codebook 
vector divided by the number of elements. The mean 
normalizes the codebook vectors thereby reducing the 
size of the codebook and thus the storage requirements. 
Address output 2 4 and mean output 26 of MRVQ 2 2 are 
coupled to the output multiplexer 28, as shown, for. 
transmission to the receiver 14 over the channel 16 
described hereinafter. The combined address 24 and mean 
26 are sometimes referred to as the vector quantized, 
input signal X^. The address and means outputs 24 , 26 
of MRVQ 22 are also coupled to an inverse mean residual 
vector quantizer (MRVQ" 1 ) 30 which is a decoder having 
stored therein a table of codebook vectors identical to 
and at the same addresses that are stored in MRVQ 22. 
The MRVQ" 1 decodes the vector quantized signal 1^ to 
produce an inverse input vector X^," 1 , which is an 
approximation of the input vector I produced by the 
image input 18. Inverse input vector I^" 1 has some 
associated measurable residual distortion or error in 
accordance with the following expression: 

In prior systems, an inverse MRVQ is typically 
remotely located for receiving and decoding the MRVQ 
output to produce a decoded input which is converted to 
an analog signal for display on cathode ray tube (e.g. 
Television). In such prior systems, the distortion 
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inherent: in the encoded MRVQ signal cannot: be readily 
corrected accurately because the receiver does not have 
distortion information. 

Xn accordance with the present invention, however, 
the residual distortion is characterized in the 

encoder/ transmitter 12 prior to transmission of the 
vector quantized input 1^, to the decoder/receiver 14 , 
and a selected significant portion of the residual 
distortion d^ is communicated to the decoder/receiver 14 
so that a correction can be made during reassembly of 
the input signal. 

The residual distortion dj. is measured or 
characterized by subtracting the inverse image vector 
X^," 1 from the vector input I t in the summer 32. In a 
preferred embodiment a portion d^ of the residual 
distortion d^. produced by the summer 32 is communicated 
to a lossless compressor circuit 34 via a truncation or 
limit circuit 36. If desired, it would be possible to 
use a lossy compressor without departing from the 
invention. 

Xn accordance with the invention, and for purposes 
explained hereinafter , the limit circuit 3 6 selectively 
limits or truncates the amount of residual distortion 
data communicated to the compression circuit to the most 
significant value, namely d„. The lossless compression 
34 compresses or encode the truncated distortion data d Ta 
from limit circuit 36 and produces as an output a 
compressed lossless residual distortion d lr . Buffer 38 
receives the encoded signal d Ir and communicates it to 
the multiplexer 28 on line 39 as shown. 

The buffer 38 has a selected capacity C. A buffer 
fullness circuit 40 responsive to the state of the 
buffer 38 produces a fullness signal F indicative of the 
buffer condition. A limit set circuit 42 responsive to 
the buffer fullness condition produces a truncation 
adjustment signal T for the limit circuit 36 so that its 



WO 92/09142 



-12- 



PCT/US90/06670 



* output is limited to the most significant residual 
distortion d*,. 

It is desirable to transmit data at a maximum 
uniform rate compatible with the capacity of the 
transmission medium or other system constraints. 
Accordingly, the encoder/transmitter 12 controls the 
amount of data transmitted over channel 16 to the 
receiver/decoder 14 by adjusting or varying the limit 
set 42 in accordance with the buffer capacity C. Thus, 
as the buffer 38 fills to capacity C the limit set 42 is 
increased to thereby selectively truncate the distortion 
data. In other words, limit set 42 establishes a 
threshold at which truncation of the distortion data 
occurs . 

In a preferred embodiment the limit set 42 is 
varied linearly over a range of buffer fullness values 
F with end limits at the extremes of buffer fullness. 
For example. Fig. 2 illustrates graphically a plot of 
the limit set values T versus buffer fullness F as a 
percentage of buffer capacity C. The curve 44 varies 
linearly as shown. At the respective lower and upper 
extremes 46 and 48 (for example less than 10% C and 
greater than 90% C) the curve 44 is flat. Thus, the 
output F of the buffer fullness circuit 40 varies 
linearly over approximately 80% of the buffer capacity 
C. However, as can be appreciated from the curve 44, 
the buffer 38 is not permitted to become empty (0% C) or 
full (100% C) , but instead the curve 44 is constant at 
the extremes 46, 48. Although the preferred 

relationship illustrated in Fig. 2 may be varied, if 
desired, it has been found that a stable maximum data 
rate from the buffer 38 is achieved by its 
implementation • 

The buffer capacity C is sufficient to allow the 
5 encoder/transmitter 12 to transmit data over the channel 

16 at a constant data rate. The buffer fullness circuit 
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40 and truncation adjustment circuit 42 provide negative 
feedback to limit set circuit 36 so that as the capacity 
C of buffer 38 is approached, data to the buffer 32 is 
reduced and vice versa. Further, because the most 
significant portion of the residual distortion is 
encoded, an effective mechanism for error compensation 
results. The most significant residual distortion d^, 
although truncated or limited, when losslessly 
compressed or encoded as d lc is useful in correcting or 
compensating for the most perceptible distortion in the 
reassembled signal. 

The lossless compressor 34 is a device capable of 
encoding distortion data losslessly (i.e. accurately and 
without its own error) • Known examples of lossless 
compression techniques include Huffman Coding, Lempel 
Zev Coding, Splay Tree Coding and Run Length Coding. 
These forms of compression are accurate. Thus, the 
significant portion of the residual distortion d„ which 
is compressed according to amy one of such techniques 
and is substantially error free. The only loss that 
exists is associated with truncation. Therefore, 
although some loss occurs, it is controlled in such a 
way that the encoder/transmitter 12 produces effectively 
no perceptible loss. Hence, the term statistically 
lossless encoding is appropriate. For example, it has 
been found that a conventional color tv picture of 512 
x 512 pixels can be magnified by a factor of eight using 
the techniques of the present invention without visually 
perceptible distortion. Thus, eight fold compression 
can be achieved without percept able distortion. 

DECODER /RECEIVER ; 

The multiplexed signals representing the vector 
quantized input 1^ (address (A) and mean (M) ) and the 
lossless residual d lr are communicated to the 
decoder/ receiver 14 via the communication channel 16. 
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The receiver 50 in the decoder/ receiver 14 captures the 
signals and d Lr . The multiplexer 52 responsive to the 
receiver 50 separates the encoded signals and produces 
corresponding address 54, mean 56 and lossless residual 
58 outputs as shown. An inverse mean residual vector 
quantizer (MRVQ" 1 ) 64 (which is identical to MRVQ" 1 30 in 
the encoder/transmitter 12) is coupled to the address 
(A) and mean (M) outputs 54, 56* MRVQ" 1 receives and 
decodes the address and mean in order to produce an 
inverse vector quantized input X^" 1 which is identical to 
the signal produced by MRVQ" 1 30 referred to above* 
Thus, the inverse vector quantized signal X^" 1 in the 
encoder/transmitter 12 which represents the 
approximation of the input vector I t having residual 
distortion d^ is reproduced in the decoder/receiver 14. 

An inverted lossless residual decoder (UC 1 ) 66 
receives and decodes the lossless residual output 58 of 
multiplexer 52 and produces a decoded lossless residual 
d lr " x . The inverse vector quantized signal X^" 1 and the 
inverse lossless residual d^." 1 are added in the summer 68 
in order to produce an image output signal I 0 which may 
be digital to analog (D/A) converted for display in 
analog output system 60. The image output I 0 is a close 
representation of the image input X t with the most 
significant portion of truncated residual distortion 
added back in . The decoded image X^" 1 is a fair 
representation of the image input I L but without 
distortion compensation. The image output X 0 has 
distortion compensation. Thus, the image output I 0 is a 
more accurate representation of the input I t them the 
inverse vector quantized input X^* 1 alone. 

The image output X Q more accurately represents the 
input I t because an accurate compensating signal (i.e. 
lossless residual d lr ) accompanies the vector quantized 
image signal 1^, for reassembly at the decoder/receiver 
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14. In mathematical terms the relationship between the 
Input I t and the output I c follows: 



Thus, the output vector I D has more information in it 
concerning the input vector X t than the inverse vector 
quantized input I^," 1 . In other words, the difference 
between a decoded vector quantized signal and the 
original input is greater than the difference between 
loss compensating output vector and the original input 
vector. The compensation also is the most significant 
portion of the error or loss. The system also takes 
advantage of the maximum bandwidth available by 
regulating the output from the encoder/transmitter 12 in 
order to maximize the data rate compatible with the 
system. The combination of an efficient vector 
quantizing circuit such as MRVQ 22 with a regulated 
lossless compressor 34 for transmitting a compensating 
signal results in statistically lossless system in which 
distortion is not perceptible at the desired resolution. 

While the invention has been described in 
connection with specific embodiments thereof, it will be 
understood that it is capable of further modifications. 
This application is intended to cover any variations, 
uses or adaptations of the invention following, in 
general, the principles of the invention, and including 
such departures from the present disclosure as come 
within known and customary practice within the art to 
which the invention pertains. 
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WHAT IS CIATMEn Tfi ♦ 

1 x - Apparatus for producing compressed data 

2 representative of an input signal comprising: 

3 vector quantizing means responsive to the 

4 input signal for encoding the input signal; 

5 inverse vector quantizing means responsive to 

6 the encoded input signal for producing a decoded 

7 input signal different from the input signal; 

8 summing means responsive to the input signal 

9 and the decoded input signal for producing a 

10 difference signal; 

11 compressing means responsive to the summing 

12 means for producing an encoded difference signal; 

13 and 

14 decoding means responsive to the encoded input 

15 signal and the encoded difference signal for 

16 reconstructing the input signal with an error 

17 smaller than the difference signal. 

1 2 - Apparatus for producing a compressed data 

2 stream representative of an input data stream 

3 comprising: 

4 vector quantizing means responsive to the 

5 input data stream for encoding it into a vector 

6 quantized stream; 

7 inverse vector quantizing means responsive to 
8 " **** vector quantized stream for producing a decoded 

9 input data stream; 

10 - nea »s for comparing the input data stream and 

11 decoded input data stream for producing a 
distortion stream representative of a difference 

13 between said streams ; 

14 

compression means responsive to the distortion 

15 stream for selectively encoding it into an encoded 

16 distortion stream; and 
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17 means responsive to the vector quantized 

18 stream and the encoded distortion stream for 

19 decoding the streams said producing an output data 

20 stream more closely resembling the input data 

21 stream than the decoded input data stream. 

1 3. Apparatus for producing an output signal 

2 representative of an input signal comprising: 

3 encoding means responsive to the input signal 

4 for producing an encoded input signal approximately 

5 representative of said input signal; 

6 first decoding means responsive to the encoded 

7 input signal for producing a decoded input signal 

8 different from the input signal; 

9 means responsive to the input signal and the 

10 decoded input signal for producing a difference 

11 signal; 

12 means compressing a selected portion of said 

13 difference signal; and 

14 second decoding means responsive to the 

15 encoded input signal and the compressed difference 

16 signal for producing a decoded output signal being 

17 different from the input signal by an amount less 

18 than the difference signal. 

1 4. Apparatus according to claim 3 wherein said 

2 means for compression is lossless. 

1 5. Apparatus according to claim 3 wherein the 

2 means for compressing the selected portion of the first 

3 difference signal comprises means for truncating the 
4 4 difference signal. 

1 6 . Apparatus according to claim 5 wherein the 

2 means for truncating the difference signal comprises 

3 buffer means having a selected capacity, said buffer 
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4 responsive to the amount of data in the difference 

5 signal, and means responsive to the buffer means for 

6 adjusting the amount of data passed to the buffer means 

7 so as not exceeded its capacity, 

2 7. Apparatus according to claim 3 wherein said 

2 difference signal contains a selected amount of data and 

3 the means for compressing a selected portion of the 

4 difference signal includes means for producing said 

5 difference signal at a relatively uniform data rate. 

1 8 . Apparatus according to claim 7 wherein means 

2 for producing said difference signal at a relatively 

3 uniform data rate comprises: 

4 a limit circuit responsive to a limit signal 

5 for limiting the difference signal, and means 

6 responsive to the compressed difference signal for 

7 producing said limit signal. 

1 9. Apparatus according to claim 8 wherein said 

2 means for producing said limit signal comprises buffer 

3 means having a selected capacity and being responsive to 

4 the data content of said compressed difference signal 

5 and a feedback loop between the buffer and the limit 

6 circuit for producing the limit signal. 

1 10. Apparatus according to claim 9 wherein the 

2 feedback loop comprises buffer fullness means responsive 

3 to the amount of data stored in the buffer for producing 

4 a fullness signal and adjustment means responsive for 

5 the fullness signal for producing the limit signal. 



1 
2 
3 



11. Apparatus according to claim 10 wherein said 
buffer fullness means comprises means for producing said 
fullness signal over a major range of buffer capacity. 
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1 12. Apparatus according to claim 11 wherein said 

2 fullness signal varies linearly over said major range of 

3 buffer capacity and further includes invariant minor 

4 portions at extremes of said buffer capacity. 

! 13. Apparatus according to claim 12 wherein said 

2 major portion of the buffer capacity is between about 10 

3 and 90% and the invariant portions of between 0 and 10% 

4 and 90 and 100%, respectively. 

1 14. Apparatus according to claim 3 wherein the 

2 means for encoding the input signal includes vector 

3 quantizing means and the first decoding means comprises 

4 inverse vector quantizing means. 

1 15. Apparatus according to claim 14 wherein the 

2 second decoding means comprises inverse vector 

3 quantizing means responsive to the encoded input signal 

4 and inverse compressing means responsive to the encoded 

5 difference signal for producing a decoded difference 

6 signal • 

1 16. Apparatus according to claim 15 further 

2 comprising summing means responsive to the decoded input 

3 signal and the decoded difference signal from the second 

4 decoder for producing said decoded output signal. 

1 17. Apparatus according to claim 3 further 

2 compris ing : 

3 transmitting means responsive to the encoding 

4 means and the compr es s ing means f or transmitting 

5 the encoded input signal and the compressed 

6 difference signal; 

7 receiving means coupled to the second decoder 

8 means for receiving said encoded input signal and 



WO 92/09142 



> 

-20- 



PCT/US90/06670 



9 said compressed difference signal and coupling the 

10 same to the second decoder means; and 

11 communications means between the transmitter 

12 and receiver for carrying said encoded input signal 

13 and said difference signal from the transmitting 

14 means to the receiving means* 

1 18. Apparatus according to claim 17 wherein said 

2 means for compressing the difference signal comprises at 

3 least one of the Huffman coding apparatus , Lempel Zev 

4 encoding apparatus; Splay Tree encoding apparatus and 

5 Run length encoding apparatus. 



19 . A method for compressing input data comprising 
the steps of: 

encoding the input data into an encoded input; 

decoding the encoded input into a decoded 
input; 

comparing the input data with the decoded 
input for producing a difference; 

compressing a portion of the difference into 
and encoded difference; 

combining the encoded input and the encoded 
difference into a compensated encoded form; 

decoding the compensated encoded form for 
producing compensated output data which resembles 
the input data more closely than the decoded input. 



1 20. The method according to claim 19 wherein the 

2 compressing step is lossless. 

1 21. The method according to claim 19 wherein the 

2 step of compressing a portion of the difference further 

3 comprises limiting said encoded difference to a 

4 relatively constant data rate. 
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22. The method according to claim 21 wherein 
encoding the data comprises the step of mean residual 
vector quantization. 

23. The method according to claim 22 wherein 
decoding the encoded data comprises the step inverse 
vector quantization. 

24. The method according to claim 23 wherein the 
decoding the compressed encoded form for producing the 
compensated output comprises the step of inverse vector 
quantization and inverse residual compression. 

25. A method for compressing data with reduced 
distortion comprising steps of: 

compressing an input signal; 

determining distortion resulting from 
compression of the input signal; 
compressing the distortion; 

combining the compressed input signal and at 
least a significant portion of compressed 
distortion; 

decompressing the combined compressed input 
signal and compressed distortion for producing a 
replica of the input with less distortion than the 
compressed input signal. 

26. The method of claim 25 wherein the step of 
compressing the distortion is lossless. 
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